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ABSTRACT 


Phase 2 of this project presents a skeletal model foc 
evaluating vocational education programs which can be applied to 
secondary, post-secondary, and adult education programs. The model 
addresses 13 main components of the vocational education system: 
descriptive information, demonstration of need, student recruitment 
and selection, curriculum, aquidance and placement, facilities, 
community involvement, youth organizations, cooperative programs, 
program's effect on students, holding power and popularity, 
satisfaction of various audiences with program, and program staffing 
and administration. Each component consists of a general rationale 
for evaluating that aspect of the vocational program, specific 
questions or subcomponents, and general approaches required to 
investigate those questions. In addition, recommendations for 


research and development relating +o each component are provided. 
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Following is a skeletal model for evaluating vocational-technical education. 
The model addresses 13 main components of the vocational education system, ‘with each 


of these components consisting of several subcomponents which may be assessed in the 
course of an evaluation effort. 


t 


The model is designed to be applicable to the individual prosram, the level at 
which most data collection takes place, and where evaluation results are utilized 
in future program planning. The collation of evaluation results from a number of 


individual programs of ‘instruction would result in a comprehensive evaluation of 
vocational education at the institutional, regional, or state-wide level. 

Most components of the model apply equally to secondary, post-secondary, and 
adult education and may eve. apply to private institutions. Roth process and out- 
come components of the vocational system are.addressed. 

This model is not intended as an evaluation instrument. Rather, it suppests 
WHAT to evaluate and WY, the ‘how’ question is addressed only in a very plobal 
sense. ~For example, it is suprested that a‘number of components may be assessed 
throurch questionnaires. In order for this skeletal model to become an operational 
one, these QUESEDONRALEES Huse be developed, and many procedural aueneiedé must be 


answered. 


In its present form, this document may be useful to state monitors in conducting, 


site visits, in that it supeests factors of the vocattonal propram which may play 


an important role in.determinine the program's overall level of ‘success. On-site 


observation and interviewing are ~y to the imolementation of many components of the 


evaluation model. Even without interview guides and rating sheets, monitors may 


find the model helpful in planning their agendas for site visits. 


Each component consists of (a) the general rationale for evaluating, that aspect 
of the vocational program: (b) specific questions or subcomponents relating to the 
component; and (c) general approaches required to investigate thdse auestions. 

In addition, recommendations. for research and development relating to each 
component are provided. In many anen the results of recommended research would be 
needed in order to fully implement the evaluation model. 

I. DESCRIPTIVE INFORMATION 
‘A. General Rationale : 

A-satisfactory slobal view of the statewide system of vocational education 
necessitates the availability of data such as the number of students served, tne 
enrollments of various areas of instruction, and the peopraphic distribution of 


vocational programs. For example, current enrollments by area can be compared to 


* 
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_ Short-term manpower needs projections to indicate the destrability of expanding 
some programs and phasing out others. Nescriptive data reviewed over a pertod of 
several years may provide a hasts for predicting future derands for instructional 
personnel and facilities. Descrintive data {gs also needed for federal reporting, 
program reimbursement, and distribution to various audiences fox nlannine purnoses. 
R,_" Suhconnonents — 

1. "hat geopraphic areca constitutes the primary service area of this site? 

' (A site may be an area vocational school, a'corprehensive hish school, a 


~ 


\ campus of TVY Tech, et¢. ) 


rh 


» “hat population(s) are served by this site (secondary, post-secondary, “ss 
adult)? , 
ee List of all proerams at the site. 
At the local or regional level, this indicates the variety of vocational 
options potentially open to a student. 
4, Job title(s) for which a student in each program is prepared. 
The curricuium may be viewed with respect to fob descriptions. 
5. Associate degree or technical certificate awarded upon completion. 
6. List and descrintion of all courses in the program. 
- This will be needed in assessing the program curriculum. 
7. “Method.of instruction (e.%., co-op, laboratory, etc.). 
8, “Number of instructors assigned to the,prorram. 
. a. Part-time’ 
b. Full-time 
c. Full-time equivalents 
9. Number of recent school leavers 
19, -Number of recent praduates 
ll. Number of new students 
12. Current program enrollments 
a. by sex 
bh. by race 
c. handicapped 
'd. disadvantaged 
13. Current enrollments in-.each course. 
A distinction should be made between program enrollees and others enrolled 
in the course. This information will suggest the derree to which the 
course provides preparation for employment as distinguished from explora- 
tory or enrichment experiences, and the number of propram enrollees is 


also used in the propram reimbursement formula. 


f 
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Ls tessihle Data Collection Approaches : 
“ost of the sugested sintowmaanmats of. descriptive information are addressed 

in forms recently developed by NED and the SRVTF for use at the post-secondary. 

“Yevel’ the Annual Program Frrollment Report and the Program Renort for each 

academic session. - These forms. which are the responsibility of each site director, : 

could he revised to Include additional suhcomponents and to anniy to the secondary 


and adult levels. Information for several subcomponents (1.e., 1, 2 4,' 5, 6, and 


/ ‘es 
7) need be reported only when new sites, programs’, or courses are instituted. 
Linited auditing of reported information is recommended. 
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b._ Recommended Research and Development 
i= 1. Identification of job titles and corresvonding job descriptions to which ; 
various tvves of vocational programs lead or may lead. A combination ofe 
two methodologies is recommended: 
a. Compile job analyses and vocational proeranm descriptions. Match - 
' appropriate jobs te program descriptions to determine the potent fal 
jobs of nroeram leavers. 
b. Perform a follow-up of leavers from vocational meorecarin of vartous 
i descriptions. Determine the titles and descriptions of the fobs 
leavers actually obtain. 
2<_.Conpite a descrintive profile of students presently considered “hand{capped” 
or "disadvantaced" and of vocational programs in which such students are 
enrolled, Vetermine the extent of coneruence from locale to locale of 
criteria used in identifying the disadvantaged and handicanped and of 
approaches used to mect the needs of these popukations. The results would 
be (a) standardized operational definitions of fartioahudd and dissdvantap-e 
ed students and (b) a sharing of methods used by various Hoosier programs 
for identifying, recruiting, and trainine chese individuals. 
II. DFMONSTRATION OF MFED 
A. Generai Rationale _ 

Two, purposes of vocational education are to fulfill the educational needs of 
students and to fulfill the manpower needs of employers. The value of any vocation- 
al educatisn program therefore depends upon the existence of the student and employer 
needs which the propram is designec to fulfill. Clearly, the need for a new program 
should be demonstrated before its institution, but it is also desirable to. period- 
ically assess the need for ongoing prorrams. It is traditionally the responsibility 
ae of the LEA to compile information concerning local needs. 
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The state and LEA. are jointly responsible for determining whether the tities 
ation, maintenance, expanston, or revision of various programs is justified in light 
of -identified needs. Such determinations cannot be effectively made without know]- 
edpe of the factors considered in assessine local needs for vocational education, 
the manner in which information was. collected, and the resilts of the needs assess- 


w 


ment. 

* The purpose of including a ‘demonstration of need | eonmonene in a statewide 
evaluation system is to provide state, regional, and local decision-makers with 
_fuidelines for assessine the reed for various vocational education prorrams based 

upon needs assessment data compiled ,at the local level. That is, this component 
* 1s not intended to provide the methodolopy for conducting a needs assessment but 
rather it is ineended to provide a means for evaluatine the vocational education 
system's needs assessment functions so that the congruence between educational 
2 programs and actual needs can be effectively assessed, 
‘B._2Subcomponents , . a 
“1. “hat factors are invasrteated in assessing the need for initiating, main- 
tainine, expanding, or revising a program? Some potentially relevant 
factors'are listed below’ j 
a. “Manpower data and projections. 
Do ISD statistics or other available data indicate a demand for person- 
nel trained in the progran area ‘under consideration? Are local, : 
repional, abate, or federal labor stacistics piven most emphasis? : 
b. The particular stills in demand within vocational areas of instruction. 
Is this kind of information available and used in program development? 
c. The partfcular employee attitudes in demand. . 
d. Preference of employers in this vocational area to hire trained 
: personnel rather than to train on the job. 
é. Statements of student career coals. 
If a new program is proposed, is there evidence of student demand for 
this, prograp? 
f. Follow-up of program leavers from the past. 
Noes follow-un data from ongoing proprams indicate the need for 


t ae 
program revision? 


er 


Prey Number of propram requests per ‘available slot. 
Based on student demand, should an ongoing program be maintaiuet, 


expanded, or phased out? 


hs 


?,. Nata collectton stratepies used in assessing, needs. 
e Can the results of the needs We aneanen’ he considered a reliable measure 
of each factot considered in the study? 
3. «Results of the needs assessment. 
Do the results indicate a real need for initiating, maintaininy, expanding, 
_or revising, the prosrar? - 
’ be Alternatives to the proposed program which vere considered, 
If a vocational education need is shown, there are alternative stratestes 
for neering that need. For examole, the identified need may be met by 
adding, a new program to any of several existine institutions such as a 
; private school, a local university, an IVY Tech extension, a comprehensive 
; high school, or a community-based training program. Were solutions other 


/ than the proposed one considered? Vere they rejected on a rational basis? 
o C. Possible “ata Collection Sources 


® 


Needs assessment reports provide the data base for this component. _ Some clar- 


ifying interviewing may be required with those resnonsible for conductin7 the 


needs assessment. : ‘ 
D.. Recommended Research and Development 
1. The development of a system for cunducting local needs assessments. The 
system should include the facters listed above and perhaps others, thouch 
i. i the option of investiratine any given factor could be left to the LEA. 
F Sources for identifying existine information such as manpower statistics 
a should be deseribed. Sampling vlans and data collection instruments 


should be included, as well as a format for reporting results. The packaee 


F must be adaptable to any locale, level, and program area. 


2. Factors b, c, and d listed under subcomponent above are rore AEHESPED- 


Ge 


ately investigated state-wide rather than at the repional or local level, 
‘since these factors probably vary less than the others from locale to 
locale. This state-wide needs assessment should be eSpepePrned pertodically, 
every three to five years. ae 

3. The development of a svstem for vhuneadine and evaluating celine for 
new programs. The system would include evaluation criteria and their 
corresponding, weiphts, as well as the composition of review panels and ao 


flowchart of the application's propress pega the review and,.selection 
procedure. 
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4, The development of a similar system for reviewing needs assessment data 


concerning existing proprams. 
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* TTT. SIUDENT RECRUITHENT ANN SELECTION 

A, Gefieral Rationale : 

Vocational vrorrams are intended to serve particular darudé *ponndattonn, 
usually those who are in need of training to achieve realistic occupational .poals. i 
If recruitment and selection procedures suspesstully enroll members of. the prorram's 
"tarpet population, both student and employer needs can be met. If recruitment 
and selection procedures are inequitable or inconsistent with proeram intent, the 
program is unlikely to meet its- obtectives and likely to come under criticism. 
Since the enactment of Title IX this area will receive particular attention. 


Be Subcomponents _ : 
1. Recruitment Strategies. a, 
7 a. For adult and post-secondary programs, what media are used to make : 
vrorram availability known? » 2 
Are these media likely to reach tarvet popnlations, including: persons 
‘not presently in school? . 
bh. At the secondary level, is the student body at larre ‘informed of 
vocational education opportunities, or is there de-facto pre-selection 
by excluding some croups from information? : 
c. What affirmative actions are taken to overcome sex-stereotyping in 
vocat fonal program choice? , 
tg d. Are unrealistic promises made at the recruitment stage? Are students 
able to obtain accurate information ahout the program itself, costs, 
selection procedures, etc.? 
2. Selection procedures 
a. "ho makes selection iecistons? Is this person or group piven ruide- 
lines for gelection, and are they followed? 
b. In the case of area schools, how are sending school allotments deter- 
mined? Are they based upon a proportion of total school enrollment, 
‘ _or upon identified needs of each school? _F 
c. What selection criteria are used, and how? 
1. Acadenic srades 
2, Conduct records 
Reg 3. Teacher recommendations 


4. Evidence of student commitment 


5. Standardized test scores sgt 


we 


ds Te © 
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6. Grade level : . hy 
- Ty. Se¥ ; ag se See 
8, Demonstrated prerequisite compentencies. a 
9: a y Are criteria spelled out and objectively applied? Is dach criterion 
“= relevant to the philosophical base of vocational education? For 
. example, are standards of academic ability. so high that the target 
: ~ povulation is excluded, so low that many students’ probabllity for 


successful eMloyment in that field is unacceptable, or at 2 level 
appropriate te the demands of the discipline? 
ae: 3 Where resources are limited, is enroilment also limited? 
: Mme vay of: avoiding the notenttally sensitive issue of selection is to 
? accept all applicants, This practice may, however, result in pocr quality ‘ 
an services to many rather than hich auality services to a few, or in a 
; . winnowine process wasteful of the student's time and of the prosran' 8 
resources. 
C._ Possible Nata follectton Aprroaches 
Recruitment and selection policies can be determined by written nolicy state- 
. ments and interviews with those responsible for policv-naking.. Actual practices 


—~are best investicated throurh questionnaires or interviews with vocational and 


7 éther students, ccunselors, and a‘missions officers. Student recor;is also provide 
information concerning selection practices when the records of selectec students 


are compared to those of rejected students. The prorram's student/teacher ratio , 
ri 


supnlies an index of subcomponent 3, - quad 
D. Recommended Research an? Nevelopment 


1. The identification of relevant*selectton criterta for various types of 


a 


4 
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‘s vocational prorrans. ° 


: An investigation of current paceutenane ant Selection procedures with 
recommendations for improvement. 


3. The development and demonstration of successful affirmative act‘on strate-. 


- gies for counteractinp sexual stereotyping of vocational program 
; enrollment. 
4. An investigation of tha most effective means of communicating, vocationale 


ecucation opnortunities at the post-secondary and adult levels. 


5. An identification of critaria for assessine the ethics of practices in 


« 


the recruitment and selection process. 
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A. General Rationale : 


The curriculum is the foundation of the vocational progran and its evaluation 


is thus an.essential component of the total evaluation system. 


“ 


Bas Subcomponents F : i 


1. Curricular ahi cebives: r 
Nell-formulated objectives provide a proaran with a sense of direction 
and purpose as well as 4 basis for continuous assessment and planning. 

- “Objectives shétld be stated in terms of desired ‘chanres in students as a 
result of the prorram and may take the form of competenctes reauired for 
employment in specified jch-catesories. Program and cqurse objectives 
may ‘be evaluated according to the following criteria: | ° 
a. Are Propram objectives stated? : 

b. Are course objectives stated? 
c. On what basis were they formulated? ° 


d. Are objectives -reasurable? &. 


e. Are objectives realistic piven the student population, available staff, 


facilities, and time? 
f. Are objectives periodically reassessed in light of the program's 
experiences? 7 
2, Individual courses in the propran, 
a. Course PRnE ER“ KORS, {t relate to course and. propram objectives? 
--Has the skill content been validated regarding ‘ 
realistic actual practices required? . 
b. Resources utilized--text, equipment, puest lecturers, etc.” 


® 
3. Program curriculum is 


a. Curriculum development--who is responsible for it and on what basis 
s 
. is it done? 


8 b.» Sequence of couraes constituting, the program. Do courses build upon 
: past’ cnes ina lopical and, non-redundant manner? Are there curricular 
provisions for meeting all propram objectives? Do all vocational 
courses relate to a propram? Are programs comprehensive or are most_ 
‘a single course? P = 
c Provdielons for advanced placement and other forms of flexibility to 
meet individual needs. , 


10 Ean, 
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4. Standards of student achievement 
a. Grading practices . ‘ 


‘ _ »b. *Measurement of student competencies 


? 9 


¢c. Criteria for program and course completion 


. 


5. Coordination among: ; 
- a. Courses in-the program rae se 
. , Bs hcademic courses ~ — Rog . 
ae c. "ork ae xt a. . j N 
d. Outside 


lated activities such as ‘youth organizations 
C. Possible Data Collection Straterics 


Examination of curriculum guides, written abiectives, ‘course textbooks, 


course descriptions, and interviews with all staff menhers will be necded. 


D, Recommended led Research ar and Development. S % 


- 


1. Develdp and demonstrate pine prograns using a systemat ier manavement -by- 
sbjectives approach, . .- 
4 Vv. GUIDANCE 47D PLACEMENT 
A. General Rationale - : ; oy 


ee es en 


Vocat ionai counseling, and placement are important student services fan them-_ 


selves and wee affect other components of the vocat ional education system. 


» Particularly ie secondary level, counselors have a strone, influence over the 


composition of the vocational student body; the results of this will influence all 


of Phe program's outcomes: The quality.of placement services may influence both 
. the program's popularity and its measured success in preparing students for enploy- 
e « Fs oo F . : 


, 


ment. = 


BR. Subcomponents 
1. Counselors 


a 


a. Qualifications as a vocational counselor. 


b. " Knowledge of available programs, job market, and a variety of 
: occupations. : 


© 


c. Availability of services to the student as measured by: 
1. Vocational student/vocational counselor ratio for the comprehensive 
a High school and student/counselor ratio at ail levels. , 
‘ 2. Counselor's job responsibilities and the anproximate propoftion 


of time devoted to each. If counselors are spread . too thin, 


‘ vocational counseling seftvices may .suffer. 
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d. Coordination / F 
1. Retween hirh schools and area sehools | : & 


+2. Between secondary and postsecondary institutions. ° 
3. Among post-secondary institdt dp 
43 4. ‘Nth adult educat f 
as “Phanemeut : ti tba j 
a. Does the institution provide hoth job and educational placenent 
“ services? 
b. Source of job opentar information. . : 
Cs Source of trainine prostan Anformation. ° ) : 
d. Method of matchine students to jobs or schools. 
e. Success rate--What rroportion of propram leavers are placed? Toes 
” follow-un data indicate that placements are satisfactory? ; : 
‘C._Possible Pata Collection Approaches 


-l. Interviews with counselors and other prorram personnel. 


‘ ® k we 
. 2.° Interviews with students. ‘ 
3 Placerent® records, : , fe 
¢ %, : .* * . 
4. Propram leaver follow-up data. ‘ ex ee 


D. Recommended Research and Development 
1. Assessment of vocational counseling needs, to answer such questions as: 
"hat are the characteristics and qualifications of those pregently con- 

- »sidered vocational counselors? Uhat are the unique counseling, needs of ‘ 
actual and potential vocational students? "hat is required to meet these 
needs? Results of such a study may be used to revise qualifications for 
vocational counselors Aynd far to develon-inservice training. programs in 
‘this area, S) m5 . 

2.~ Development of a job placement model for use by vocational programs at 


all levels. ; : ‘ : ‘ 


“ 


: ‘{ VI. FACILITIFS ~ ao 8 
Ae” General Rationale x : 


. 
e u 


“Biildings, equipment, and materials represent sizeable investments in most 
vocational prograns. At the same time the avatlability of ‘adequate facilities is 
an (mportant determinant of the programs’ scope and Aunldey, It is, therefore, 
aneenbinl that vocational funds be invested in a cost-ef fective manner. Including a 
facilitites component in the evaluation system is. desirable because appropriate 


recommendations for improving the cost-effectiveness of Facilities can nave. a stirene 


and positive thpact on peoprar ais he is # 


d | 4; 12 . : 
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R. Subcomponents 4 


; ie An inventory of major equinment and cost. , * : 
A description of equipment is needed before its need and utilization can 
n “ “be evaluated. Costs can a)su be related to usage to determine. cost~ 
effectiveness. '‘''Ndjor’ may be defined in terms of an arbitrary minimum 
cost. 
2. The relationship between propram objectives and factlities. 
a. Are all facilities which are required to meet program objectives - Weg 


a 


avatiable. 


“b. Are all facilities necessary to the fulfillment of program objectives? 
That is, are existing facilities both ‘sufficient and justified in om 
terrs of proeram objectives? : ~ 
Sie The relationship between facilities and. those ‘found i in business 
: er . and industry. ; a 
a Training in the propram should transfer positively to work situations. If 
” equipment used for training is sukstantially different from that commonly 
yused elsewhere, this training. may not transfer or, worse yet, there may be 
a hepative traisfer of learning to the wave situation. 


4, Maintenance of facilities. 


me 5. Instructar's proficiency. in operating equipment and in denonst rating, the 
method of operation. /: ; 

‘¢ ; : 6. ‘Compl tance with OSHA regulations and other sitet safety standards 4 

ee 7 : 7. “The method of monitoring or controlling the use of expendable materials. 


3. etlization of building, r rooms, and major piece# of enutpments as measured 
‘ . . dn ‘one or. more of the following ways: 
’ an : “a. The A mber, of stydents using the facility per year. 
ee . bs = The “‘Lenath. of tine. any individual student would utilize the factlitys, 
| c. The approximate proportion of time the facility is in use. 
ave Use by. maltiple Profrans, pn as nigtit or summer courses in addition 
“to refiutar ones. = Rigs Ae d ‘ 
If gostly facilities are under-util{zed, it may be recommended that mutétpne 
' programs share facilities and/or that: attempts be. made in the future to 
utilize comrades: resources for instruction. on, specific peices “of equipment. 
Ce Possible Nata Collection Approaches 
Institutional records, “if: continuously maintained, shoyld provide a an inventory ° 
) Z roMs si el teas mn aera ciara can ie NR 
_ sugrested measures of utilization.” ay : , A 
. : F f 
A ee : x AB | | ; 
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The remaining subcomponents would require inspection of facilities and inter- 
: views with instructors. : 
"-D._Teconmended Research and Develonrent 
| 1. The collection and examination of job descriptions correspondine to each 
area of vocational training, to determine required competencies and the 
facilities needed to develop those competencies. This information would 
facilitate the developmenc of propram objectives and the identification of 
Facilities necded to meet those objectives. 
ze ON yaries of SNPS YOEs in various vocational areas ee instruction to 
determine the brand names and models of equipment commonly used in business - 
and industry. This information would provide one important basis for 
decisions concernine, the nurchage of facilities. 
3. Compilation wf a handhook for- vocat ional edu@ators civinp lay interore- + 


tations of OSI\ and other safety standards applicable to vocational 
education. 


4, Compilation of a list of vendors who have aereed to sell, rent, or main- 
tain equipment to vocational education nrograms on favorable terms. 
VII. PROGRAS STAFFING AND ANMTNISTRATIO™M 
k 4 


A. General Rationale 


+4 


_ Proeram staffing and administration:are elements of all components of the 
vocat ional education system and. are at least indfrectly addressed in ‘other proposed 
components of the evaluation model. This component is intended as a more direct 
assessment of vropram administrative functioning. 
2,__Subcomponents 

. 1. Staffing Plan 


La. Organizational structure. Are the Pelabeaneneye among, staff Rennes 


clear and conducive to intra-staff cormunteat ton? 

b, Staff assipnments and job descriptions. Are the responsibilities of 
staff members delineated? Are they related to program objectives? 

c. Staff qualifications. Are they consistent with job descriptions? In ‘ 
the case. of instructional personel , are all state and local require- 
‘mont met? Do teachers possess demonst rated competencies in their 


instructional areas? 


‘d. Consultants from within and outside of the program. If consultants 


are used, how are they used? © ° 
LO LAOS RTE NEN he AE OR RN TB 
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srexvoutereretenaaneteansidet eeeteisssbmtnensesneonprneemasin.ontnendtnes sseineresicinetc tnt 
e. Staff utilization. Do staff members spend most of their time on 
approvrdately assigned responsibilitfes? 


; aA | : : 
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t 


‘13s 


/ : 


f. Staff communications. Are working relatfonshins amonr members 
y 


established? Does the staff meet verfodtically for sroup vlanning? 

2. Fiscal control “ 

3. Coordtnation of multiple programs. Are there provisions for the coordina- 
tion of multinle proerams at a given site and programs in a piven inst ruc- 
tional area within a repion? 

4, Ethical practices iy 

- ae PEREROUTER for nhasing out old programs. Are the interests of students 
j currently enrolled in a discontinued program safecuarded? 
b. Fidedon. and fee refund policies. Are policies stated and followed? 
C. Possible Data Collection Approaches 

t Fez Interviews with each staff member will be needed. Other possible sources of 

 gnforration are orpanizational charts, job descriptions, employment BD ARNO 

and minutés from staff meetinos. 


dD. Recommended Research _and Development 


\,' 
f 1. An analysis of existing practices of personnel selection, fasinaine job 
reduirements and selection criteria for all staff positions in the vocation- 
: al program. | 
VIII. COMMENT TY INVOLVEMENT 
‘ A. / General Rationale 
. The vocational education system is intended to be responsive to community 
i heeds. At the same time. the community can provide valuable resources to the hess 
vocational education System. Such a mutual exchange of services requires a funct ton- 
ine interface between educational institutions and the working, community. | 
P 1. Efforts to identify and tap community resources, Community-based proprams 
. such as co-op and work-study clearly require the cooperation and involve- 
ment of.community employers. local businesses may also provide financial 
s assistance, materials, facilities and personnel to enhance the school 
yocational program. Nave efforts been made" to elicit community support 
of vocational education? hat successes have been shown? Is it likely 
, / that further effort in this area would be benefictal to the prorram? , 


4 


2. Advisory Committees. ’ 
Advisory committees are intended to provide a contact noint -betveen 


vocational education and the community. Following are some quest-ions * 


pepienieineteiiineneaieieaiieae 


Leet Te DORE meee 
relating to their funet toning 


a ee eS Se 
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° Recommended Research and Development 
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a. Does one exist for the institution, as required by law? 

b. Does one exist for each proeran, as required by law? 

c. Who are their members? Is the representation appropriate for each 
program? for the institution? 

d. How often do they meet? 

e. What do they do? 


ath fe haematite Rath eave ia eddie Acts 


Interviews with procram Aiveseabe ae others responsible for community 
relations would provide.some insight concerning experiences with community resources 
Mbservations of advisory committee meetings and. interviews with committee members 


may he recommended. ‘inutes could indicate both the frequency’ and functions of 


_committee meetings. , 

1. Describe the composition and activities of a large sample of advisory | 
committees. Identify those factors which lead to effective involvement 
of committees in the vocational program. 


IX. YOUTH ORCANIZATIONS 


A. Seneral Pationale » 


Youth organizations can provide valuable experiences relating to a prorran's 
objectives and may also be used asia mechanism for studeitt input” into instructional 
propgran planning. 

ANS ie. Hephewatits 

2. Objectives 7 . gay 
Are the organization's objectives complementary to curricular objectives? 

3. Activities 7 J 
4, Role in program policy-making ; 

Do students have any influence over the ins* “ruct ional program? 
C. Possible Data Collection Approaches 

The organization's constitution, by-lavs, membership roles, and minutes of 
meetings will give an indication of I,.2,. and 3 above. ‘Interviews with the 
orpanization's officers and sponsors may also be needed, ' 

1. Pilot projects at both the secondary and post-secondary levels in which 
student organizations have heavy influence in prorram plannine and 
execution. Proposals for su ° o-shoutd-det-inerte—-the-responsthil-—__. 
ities to be delegated to students and plans for evaluating the effective 
ness of the project. , ze 
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X. COOPERATIVE PPOGRANS 
A. General _Rationale 
All components of the comprehensive evaluation rodel apply to cooperative 
programs as well as regular ones, but some characteristics of co-op programs 
require unique evaluation apyroaches. 


B.  Subcomponents _ 


1. Transportation arrangements. ‘Can students without cars participate in 
co-op prograns? 
2. Training acreenents . 

a. Are they maintained? 


b. Do avreements specify anpropriate competencies to be developed? 


Coordination between teacher-coordinator and employer: 
a. How often are training stations visited? 
b. Are training agreements enforced? , 
Cs How is classroom instruction related to rR experience? 
4. Coftpliance with applicable employment laws. ; 
C, Possible Nata Collection Approaches 
1. Training arreement records. 
2. Teacher-coordinator itineraries. 
3. Interviews with teacher-coordinators,’ ernloyers, and students. 
D. Recommended Research and Development 
L. 


Compile a manual describine state and federal employment reculations as 
they apply to co-op and voriestudy programs, including minimum ware, 
equal. opportunity, and child labor laws. 


XT. PROGRAN'S EFFECTS ON STUDEMTS 
A. General Rationale 


The major voal of vocational education is to PEREAEE students for ee ere 


The assessment”of this poal's attainment is therefore an ‘essential component of ge 

the evaluation systen. | 4 . 

R. _Subcomponents a | 

1. Vocational skills acquisition. To what extent do students attain the- 

competencies the program.is intended to develon? Studént success on 
licensing, exams is one relevant criterion for some proerams. 

> 2, ~Vork-related personal skills. If the nrogram objectives include the 
development of positive work attitudes, pood work habits, job-seeking, 


er na 


skills, or other non-technical skills, these should also be assessed. 


j' 
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3. Employability of prorpram leavers. Subcomponents 1 and 2 address the 
potential enployability of: program leavers. Follow-up data’ indicate actual 
success in securing employrent by showing the number who become ' 
a. employed in exact area of training. 
b. employed in an area related to training. 


» employed in unrelated areas. . , 
\ / 


iy 


Cc 
d. unemployed 
e. enrolled in further related training programs. 
f. enrolled in unrelated trainine proprams. 
4, At the adult level, change in income ‘or job position as a result of the 
program may be more appropriate than 3 above. 
C. Possible Data Collection n_ Approaches 
Subcomponents 1 and 2 would be best asseased by examination of dike of 
existing, student testing, including classroom ‘skills tests and licensinr exams. 
imited skill testing, for the purpose of program evaluation may he desirable; but 
is likely to be costly and time consuming. 
Where student follow-up information igs collécted and vept on file, subcompo- 
nents 3 and 4 could he easily assessed, 
D. Recommended’ Research and Development 
1. After job titles are matched to vocational propram-names | aud Phone jobs 
are analyzed according to require’ competencies, develop techniques for 
measuring students’ competency levels on tasks required of the job. 
2. Develop a transportable model .for followine up program leavers. The 
model should include questionnaires addressing a variety of evaluation 
needs, recommendations concerning the logistics of the follow-up Survey, 
guidelines for sampling plans, and suggestions for’data analysis, inter. 
pretation, and utilization. ~ - at 
XIZ. HOLDING POWER AND POPULARTTY “ 
A. General Pationale : 
Several unohtrusive measures of student pereépt ions of vocational programs 
are suggested here. These data may indicate the desirability of discontinuing, 


maintaining, expanding, or revising. procrams. a ~ 


\ 


B. Subcomponents : 


1. The number of applicants to the program. : 
“hereas..projected.demands-may.-be-est-imated-dir-the-meed Asse peme Re wnnn men nnrnnnen 


preceding the propram's institution, the actual demand should also be 


considered. 
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Data Collection Approaches 


eae 


to 


Number of transfers into and ont of each program within the institution. 


-Students attending an institution eencrally have extensive first- and ‘ 


second-hand experience with most programs within the institution. Their 
tendencies to transfer into and out of various programs are based upon 
relatively reliable information and should be considered seriously. 

Number of program beginners completing ‘the program. If a larpe percentage 
of those initiatinp the program drop out before completion, the reasons 
for this should be examined. There may be a’need to revise the program 
{tself and/or its selection procedures. Qn the other hand, it is possible 
that many students are able to attain their personal trainine objectives 


before officially praduattne. 
ra 


School records should contain all data needed for this comnonent. 


-D._Recormended Research and Development 


A. 


~ Mone’ recommended. 


XTIT. SATISFACTION OF VARIOUS . 
AUDIENCES WITH PPOGRAT 


General Nationale 


All participants in and audiences of vocational education can provide valuable 


feedback tu the program. Their reactions to the present program and suepestians 


o 


for improvement should be carefully considered in makine future plans. 


» _ Subcomponenats 


The following groups nay be surveyed in order to fdentify their perceptions 


of various aspects.of the institution and its prograns and to elicit their recom- ' 


— 


mendations for propram revision, 


t 
r] 


1. 
- 
3, 
4. 
5. 
6. 


Program staff 
Students 
Ex-students : 

Parents (at the secondary level only) 

Employers : ‘ 


Non-vocational educators 


C. Data Collection Approaches 
Questionnaires and/or interviews. ¥ 


“D. Recommended Research and Nevelopment 


tanta sn ronenen fy Pevalonquestionnaire forms.and intervicw guides., 


2 


/ 


eee ae 


Initiate pilot follow-up studies to develop effective follow-uv models 
and forms. 
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